38,h  Annual  Precise  Time  and  Time  Interval  (PTTI)  Meeting 


A  LONG-TERM  COMPARISON  OF  GPS  CARRIER- 
PHASE  FREQUENCY  TRANSFER  AND  TWO-WAY 
SATELLITE  TIME/FREQUENCY  TRANSFER 


Christine  Hackman' 

JILA,  University  of  Colorado 
Boulder,  Colorado,  USA 

Judah  Levine 

Time  and  Frequency  Division  and  JILA 
National  Institute  of  Standards  and  Technology  and  University  of  Colorado 

Boulder,  Colorado,  USA 

Thomas  E.  Parker 

Time  and  Frequency  Division,  National  Institute  of  Standards  and  Technology 

Boulder,  Colorado,  USA 


Abstract 

GPS  carrier-phase  frequency  transfer  (GPSCPFT)  and  two-way  satellite  time  and  frequency 
transfer  (TWSTFT)  were  performed  along  three  transatlantic  links  over  the  6-month  period  29 
January  -  31  July  2006.  The  GPSCPFT  and  TWSTFT  results  were  subtracted  in  order  to 
estimate  the  combined  uncertainty  of  the  methods.  The  frequency  values  obtained  from 
GPSCPFT  and  TWSTFT  agreed  at  1.8  to  3.8-10'16  RMS  for  averaging  times  of  30  d,  with  no 
single  value  of  y gpscpft  -  y twstft  exceeding  5.5-10'16.  These  RMS  frequency-accuracy  values 
were  equal  to  or  less  than  the  frequency-stability  values  oy(GPSCpFT)  -  y(rwsTFT)  (V  (or  TheoBR  (i)) 
computed  for  the  corresponding  averaging  times;  in  general,  no  frequency  bias  between 
GPSCPFT  and  TWSTFT  was  observed.  The  transfer  noise  of  the  links  varied  with  time  of  year, 
which  was  especially  noticeable  in  the  y  gpscpft  -  y  twstft  values  obtained  for  10-15  d  averaging 
times:  yGpscPFT  -  y twstft  (10  d)  sometimes  became  as  large  as  2-10  IS.  It  is  not  yet  clear  what 
caused  these  variations.  RMS  (y  gpscpft  -  y  twstft,  10  d)  ranged  from  0.7  to  1.110'15,  with  these 
RMS  values  approximately  equal  to  O^gpscpft)  -  y(rwsTFT)  (x  =  10  d,  21  h).  Day -boundary 
discontinuities  were  not  removed  or  otherwise  circumvented  in  this  experiment;  we  hope  to 
reduce  the  uncertainty  at  shorter  averaging  times  (e.g.,  10  d)  through  better  management  of  these 
discontinuities,  along  with  improved  understanding  of  the  seasonal  components. 


INTRODUCTION 

Primary  frequency  standards  (PFSs)  can  now  achieve  fractional  frequency  uncertainties  of  several  parts  in 
1016  in  the  laboratory  [1].  However,  to  compare  the  frequency  of  one  PFS  to  another,  or  to  use  a  PFS  to 
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calibrate  the  rate  of  International  Atomic  Time  (TAI),  one  must  compare  the  frequency  of  the  local  oscillator 
(LO)  used  to  evaluate  the  PFS  to  either  the  frequency  of  TAI  or  to  the  frequency  of  the  second  PFS’s  LO.  A 
PFS  evaluation  typically  takes  15-30  d;  since  the  uncertainty  of  the  transfer  is  dominated  by  phase-noise 
processes  for  short  averaging  times,  the  uncertainty  of  a  frequency  transfer  typically  decreases  with  time.  In 
order  to  take  advantage  of  these  small  in-lab  uncertainties,  one  must  wait  for  the  uncertainty  of  the  frequency 
transfer  to  decrease  to  a  few  parts  in  1016,  or  even  into  the  10  17  range,  if  possible. 

GPS  carrier-phase  frequency  transfer  (GPSCPFT)  and  two-way  satellite  time  and  frequency  transfer 
(TWSTFT)  may  reach  frequency  uncertainties  in  the  10  16  s  in  several  days  to  a  few  weeks  [2-5].  We  lack 
information  about  the  frequency  stability  of  the  individual  methods  at  these  averaging  times.  However,  the 
difference  of  the  frequency  values  yielded  by  the  two  techniques  represents  an  estimate  of  the  combined 
uncertainty  of  the  techniques,  assuming  that  the  errors  in  the  two  techniques  are  uncorrelated.  We  can  use  the 
difference  of  the  frequency  values  obtained  to  set  an  upper  bound  on  the  uncertainty  of  either  method.  Or,  for 
example,  we  can  attribute  the  combined  uncertainty  equally  to  both  methods,  and  thus  divide  the  difference  of 
frequency  values  by  V 2  and  use  that  result  to  estimate  the  frequency  uncertainty  of  either  method. 

We  performed  frequency  transfer  across  three  transatlantic  links  using  both  GPSCPFT  and  TWSTFT  over 
the  6-month  period  29  January  -  31  July  2006  (MJDs  53764-947).  The  primary  goal  was  to  examine  the 
long-term  combined  frequency  accuracy  and  frequency  stability  of  the  two  methods.  The  experiment  also 
gave  us  ample  opportunity  to  examine  the  agreement  between  yGPscPFT  and  y twstft  at  averaging  times  of  10- 
30  d.  This  allowed  us  to  assess  the  suitability  of  the  two  systems  in  evaluating  PFSs. 


DATA  COLLECTION  AND  ANALYSIS 

GPSCPFT  and  TWSTFT  were  performed  between  the  National  Institute  of  Standards  and  Technology 
(NIST;  Boulder,  Colorado,  USA)  and  three  European  laboratories:  National  Physical  Laboratory  (NPL; 
Teddington,  U.K.);  the  Swiss  Federal  Office  of  Metrology  (METAS;  Wabern,  Switzerland),  and 
Physikalisch-Technische  Bundesanstalt  (PTB;  Braunschweig,  Germany).  At  each  of  these  laboratories,  a 
single  hydrogen  maser  is  used  as  the  frequency  reference  for  both  the  GPSCPFT  and  TWSTFT  systems.  The 
lengths  of  the  METAS-NIST,  NPL-NIST,  and  PTB-NIST  links  are  7734,  7118,  and  7532  km,  respectively. 

Figure  1  shows  the  station  locations.  The  unlabeled  blue  dots  indicate  additional  GPS  receivers  (operated  by 
the  International  GNSS  Service  (IGS)  [6])  whose  measurements  were  included  in  the  GPS  data  analysis  in 
order  to  help  resolve  integer-cycle  ambiguities  [7].  Table  1  lists  the  GPS  and  TWSTFT  equipment  used  at 
NIST,  METAS,  NPL,  and  PTB.  Table  2  lists  the  auxiliary  GPS  stations  used  in  the  analysis.  The  GPS 
receivers  at  NIST  and  PTB  are  not  the  same  as  those  receivers  (IGS  designations  NISU  and  PTBB)  whose 
tracking  data  are  submitted  to  the  IGS  network. 

TWSTFT  data  were  collected  every  2  h.  Each  2  h  data  collection  consisted  of  120  1-s  measurements;  these 
120  measurements  were  reduced  to  a  single  time-transfer  value  according  to  ITU-R  TF.  1153-2  [8].  GPS 
measurements  were  taken  every  30  s  and  then  analyzed  -  along  with  tracking  data  from  the  auxiliary  stations 
-  in  24  h  batches  using  GIPSY  Orbit  Analysis  and  Simulation  Software1  provided  by  the  Jet  Propulsion 
Laboratory  (JPL)  [9].  Both  carrier-phase  and  pseudorange  measurements  were  included  in  the  analysis.  The 
data  were  processed  using  precise  satellite  ephemerides  and  weekly  SINEX  station  coordinates  provided  by 
the  IGS  [10].  SINEX  coordinates  were  typically  available  for  all  sites  except  for  1ST,  PTB,  and  METAS;  the 
coordinates  of  these  three  stations  were  estimated  as  pail  of  the  analysis.  Earth-orientation  parameters  were 
obtained  from  the  International  Earth  Rotation  Service  (IERS)  [11];  ocean-loading  coefficients  were  obtained 
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from  the  Onsala  Space  Observatory  [12]. 


Figure  1.  GPS  and  TWSTFT  sites.  The  labeled  red  dots  mark  the  GPSCPFT/TWSTFT  sites 


whose  frequency-transfer  links  we  examined.  NIST  =  National  Institute  of  Standards  and 
Technology  (Boulder,  Colorado,  USA),  METAS  =  the  Swiss  Federal  Office  of  Metrology 
(Wabern,  Switzerland),  NPL  =  National  Physical  Laboratory  (Teddington,  U.K.),  and  PTB  = 
Physikalisch-Technische  Bundesanstalt  (Braunschweig,  Germany).  The  equipment  used  at 
these  sites  is  listed  in  Table  1.  The  unlabeled  blue  dots  indicate  IGS  GPS  tracking  sites 
whose  data  were  added  to  the  GPS  analysis  in  order  to  assist  in  ambiguity  resolution  [7]. 
Table  2  lists  the  locations  and  tracking  equipment  for  these  sites. 


Table  1.  GPS  and  TWSTFT  Hardware  Used  in  Links  Studied. 


Site 

IGS 

code 

GPS 

TWSTFT 

receiver 

antenna 

modem  numberA 

antenna 

NISTB 

AOA  SNR-8000  ACT 

AOAD/M T 

78 

3.7m  Andrew 

METAS 

WAB2 

Ashtech  Z-XII3T 

ASH700936F_C 
with  snow  radome 

281 

1.8m  Protline 

NPL 

NPLD 

Ashtech  Z-XII3T 

AOAD/M T 

74 

2.4m  ERA 

PTBB 

AOA  SNR-8000 

AOAD/M T 

03 

1.8m  Vertex 

aAII  stations  used  TimeTech  SATRE  modems.  BNot  the  same  as  IGS  receivers  “NISU”  and  “PTBB. 


Both  satellite-  and  receiver-clock  parameters  were  estimated  in  the  GPSCPFT  analysis;  NIST  was  used  as  the 
reference  clock  relative  to  which  all  other  clock  values  were  estimated.  The  data  analysis  produced  one  time- 
transfer  value  every  300  s.  Note  that  in  this  paper,  we  use  the  term  “time-transfer”  as  shorthand  for  “time- 
transfer  within  a  constant,”  because  not  all  of  the  GPS  links  have  had  their  equipment  delays  measured.  Day¬ 
boundary  discontinuities,  i.e.,  time  jumps  of  50  ps  to  1  ns  that  occur  between  the  end  of  one  GPSCPFT 
processing  batch  and  the  beginning  of  the  next  [13],  were  not  removed  or  otherwise  mitigated.  Thus,  the 
GPS  time-transfer  values  can  have  a  discontinuity  every  24  h.  This  will  be  further  discussed  later  in  the 
paper. 
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Table  2.  GPS  Hardware  Used  in  Auxiliary  IGS  Sites. 


Site 

(IGS 

code) 

Location 

GPS  receiver 

GPS  antenna 

ALGO 

Algonquin  Park,  Canada 

AOA  Benchmark  ACT 

AOAD/M_T 

AMC2 

Colorado  Springs, 

Colorado,  USA 

Ashtech  Z-XII3T 

AOAD/M_T 

NLIB 

North  Liberty,  Iowa,  USA 

AOA  SNR- 12  ACT 

AOAD/M_T  +  JPLA  radome 

NRC1 

Ottawa,  Canada 

AOA  SNR- 12  ACT 

AOAD/M_T 

OPMT 

Paris,  France 

Ashtech  Z-XII3T 

3S-02-TSADM 

STJO 

Saint  John’s, 
Newfoundland,  Canada 

AOA  Benchmark  ACT 

AOAD/M_T 

WSRT 

Westerbork,  Netherlands 

AOA  SNR- 12  ACT 

AOAD/M_T  +  DUTD  radome 

We  examined  the  agreement  of  the  time-transfer  values  produced  by  GPSCPFT  and  TWSTFT  by  subtracting 
the  time-transfer  values  produced  by  TWSTFT  from  those  produced  by  GPSCPFT.  In  performing  this 
subtraction,  the  GPSCPFT  time-transfer  value  whose  time  tag  most  closely  matched  that  of  the  TWSTFT 
time-transfer  value  was  used.  The  GPSCPFT  and  TWSTFT  time  tags  were  within  1  minute  of  each  other. 
Finally,  a  constant  was  subtracted  from  each  of  the  GPSCPFT-TWSTFT  time  series. 

We  examined  the  combined  frequency  stability  of  the  GPSCPFT  and  TWSTFT  methods  by  computing  the 
overlapping  Allan  deviation  ay(x)  of  the  time-difference  points  [14].  This  statistic  yielded  frequency-stability 
values  out  to  x  =  21  d  8  h;  we  applied  the  statistic  TheoBR  (“bias-removed”  Theol )  [15]  to  extend  the 
frequency-stability  estimates  out  to  x  =  64  d.  The  time  deviation  ox(x)  was  also  computed.  All  stability 
statistics  were  computed  using  Stable32  Frequency  Stability  Analysis  Software  [16]. 

oy(x)  is  insensitive  to  a  nonzero  average  value  of  yGPscPFr  -  y  twstft?  in  other  words,  it  will  not  detect  a 
constant  difference  in  the  frequency  values  yielded  by  the  two  methods  [14].  Therefore,  to  assess  the 
frequency  accuracy  of  GPSCPFT  and  TWSTFT,  we  examined  the  difference  in  the  frequency  values 
produced  by  GPSCPFT  and  TWSTFT  for  the  10  d,  15  d,  and  30  d  periods  shown  in  Table  3.  Computations 
were  performed  using  the  values  shown  in  Figures  2a-c:  for  a  given  period  (e.g.  MJD  53765-74),  the 
difference  between  the  fractional  frequency  value  obtained  from  GPSCPFT  and  that  obtained  from  TWSTFT 
was  computed  using  endpoints,  i.e., 


y  b- a  (h’h)  GPSCPFT  }’ B- A  F|  dl) TWSTFT  ~ 


XB-A  (f2  )  GPSCPFT  -TWSTFT  XB-A  (6  )  GPSCPFT-TWSTFT 


(1) 


where  Xba( l )  gpscpft-twstft  denotes  the  difference  in  the  time-transfer  estimates  obtained  from  GPSCPFT  and 
TWSTFT  for  Clock  B  -  Clock  A  at  time  t,  i.e.,  the  values  shown  in  Figure  2.  Each  frequency-difference 
value  was  assigned  a  time  tag  corresponding  to  the  midpoint  of  the  dates  over  which  the  frequency  difference 
was  computed. 

The  shortcut  of  Equation  1  assumes  that  we  would  have  computed  the  frequency  from  GPSCPFT  and 
TWSTFT  using  the  endpoint  method  (y[ti,  t2]  =  [x(t2)  -  x(ti)]/[t2  -  ti]).  If  we  had  chosen  to  use  different 
methods  for  computing  the  frequency  from  TWSTFT  and  GPSCPFT,  then  we  would  have  had  to  compute 
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yGPSCPFT  and  yrwsTFT  separately  before  subtracting. 


RESULTS 

Figures  2a-c  show  the  results  of  subtracting  the  GPSCPFT  and  TWSTFT  time-transfer  values.  No  long-term 
frequency  difference  between  GPSCPFT  and  TWSTFT  is  observed. 

The  day-boundary  discontinuities  in  the  METAS-NIST  GPSCPFT  solutions  were  typically  100-300  ps  in 
magnitude,  which  means  that  every  24  h  (or  12  points),  there  is  a  jump  in  the  GPSCPFT -TWSTFT  values  of 
Figure  2a  approximately  equal  to  10-30  %  of  a  major  y-axis  division.  The  day-boundary  discontinuities  for 
NPL-NIST  (Figure  2b)  were  similarly  sized.  The  day-boundary  discontinuities  for  PTB-NIST  (Figure  2c) 
were  typically  300-600  ps,  i.e.,  30-60  %  of  a  major  y-axis  division. 


Table  3.  Modified  Julian  Dates  Used  for  10-Day,  15-Day,  and  30-Day  Frequency  Comparisons. 


10  days 

15  days 

30  days 

53765-74 

53765-79 

53765-94 

53775-84 

53780-94 

53785-94 

53795-804 

53795-809 

53795-824 

53805-14 

53810-24 

53815-24 

53825-34 

53825-39 

53825-54 

53835-44 

53840-54 

53845-54 

53855-64 

53855-69a'c 

53860-74b 

53855-84 

53865-74 

53875-84 

53870-84a'c 

53885-94 

53885-99 

53885-914 

53895-904 

53900-14 

53905-14 

53915-24 

53915-29 

53915-44b,c 

53918-47a 

53925-34 A'B 
53927-36c 

53930-44bc 

53933-47a 

53935-44b 

53937-46c 

53938-47a 

aMETAS-NIST  bNPL-NIST  cPTB-NIST 
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x(NPL-NIST,  GPSCPFT)  -  x(NPL-N1ST,  TWSTFT) 


MJD 


x(PTB-NIST,  GPSCPFT)  -  x(PTB-NIST,  TWSTFT) 


MJD 


x(METAS-NIST,  GPSCPFT)  -  x(METAS-NIST,  TWSTFT) 


jump  of  30.3  ns  removed 
from  TWSTFT  at  53886 


day-boundary  discontinuities  (1 00-300  ps)  not  removed 


1 

1 

1 

53750 

53800 

53850 

MJD 

53900 

53950 

Figure  2.  Difference  between  GPSCPFT  and  TWSTFT  time-transfer  values.  Aside  from 
data  outages,  there  is  one  point  every  2  hours.  An  arbitrary  constant  has  been  subtracted 
from  each  of  the  plots,  i.e.,  there  is  no  physical  significance  to  the  fact  that  the  mean  values 
do  not  equal  zero. 
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In  order  to  construct  Figure  2a  (and  results  derived  from  it),  a  discontinuity  of  30.3  ns  was  removed  from  the 
METAS-NIST  TWSTFT  data  of  MJD  53886  (31  May  2006).  This  discontinuity  was  related  to  problems  in 
the  METAS  measurement  system  [17].  The  size  of  the  discontinuity  was  estimated  by  comparing  the 
GPSCPFT-TWSTFT  (time)  values  before  and  after  the  jump.  Discontinuities  of  1398,  342,  and  148  ns  were 
removed  from  the  PTB-NIST  GPS  time-transfer  estimates  on  MJDs  53888,  53926,  and  53936  (2  June,  10 
July,  and  20  July  2006),  respectively  (Figure  2c).  These  jumps  were  associated  with  restarts  of  the  PTB  GPS 
receiver  [18].  A  jump  of  about  500  ps  can  be  observed  in  the  NPL-NIST  differences  near  MJD  53930  (14 
July  2006;  Figure  2b).  While  this  jump  does  occur  between  the  end  of  one  processing  batch  and  the 
beginning  of  the  next,  which  would  make  it  consistent  with  a  day-boundary  discontinuity,  if  it  were  indeed  a 
day-boundary  discontinuity,  it  seems  unlikely  that  the  difference  values  from  53930-47  would  remain  at  this 
new  “lower”  value.  The  origin  of  this  jump  is  unknown. 

The  y  scales  of  the  Figure  2  plots  span  5  ns.  This  level  of  noise  is  comparable  to  that  shown  in  [3]  for  the 
PTB-NIST  link.  Different  receivers  were  used  in  [3]  than  in  this  experiment.  Lahaye  el  al.  [4]  achieved  a  y- 
scale  span  of  only  2  ns  for  GPSCPFT-TWSTFT  along  the  Paris,  France-Colorado  USA  link  OPMT-NISU 
over  a  period  of  16  d  (MJDs  53316-53332;  November  2004).  We  achieve  that  in  the  later  few  months  of  the 
METAS-NIST  link  (Figure  2a). 

Figures  3a-b  show  Gy(x),  TheoBR  and  ox(t)  computed  from  the  time-difference  values  shown  in  Figure  2. 
Due  to  data  outages,  stability  values  were  computed  using  the  following  subsets  of  data:  METAS-NIST, 
53764-938;  NPL-NIST,  53772-947;  PTB-NIST,  53764-947.  Of  these  subsets,  METAS-NIST  was  missing 
75  out  of  a  possible  2100  data  points,  an  outage  ratio  of  3.6  %.  NPL-NIST  and  PTB-NIST  had  outage  ratios 
of  151/2112  =  7.1  %  and  172/2206  =  7.8  %.  Data  gaps  do  not  alter  Stable32' s  computation  of  ay(x), 
because  if  one  or  more  of  the  three  phase  points  needed  to  compute  a  frequency  difference  is  missing, 
Stable32  ignores  that  (would-be)  contribution  to  the  RMS  and  moves  on  to  the  next  frequency-difference 
point.  However,  data  gaps  do  alter  Stable  32' s  computation  of  ox(x)  in  that  St  able  32  interpolates  the  missing 
phase  points  prior  to  computation. 

As  Figure  3a  shows,  the  combined  frequency  stability  of  GPSCPFT  and  TWSTFT  improves  with  increased 
averaging  time.  CfyopscPFr)  -  y(TwsTFT)  (x  =  32  h)  =  4.8,  5.7,  and  6.0-10  15  for  METAS-NIST,  NPL-NIST,  and 
PTB-NIST,  respectively,  ct^gpscpft)  -  ycrwsTFT)  (x  =  256  h  (10  d  16  h))  =  0.7,  1.1,  and  1.2-10  15  for  METAS- 
NIST,  NPL-NIST,  and  PTB-NIST.  At  x  =  512  h  (21  d  8  h),  these  values  are  3.5,  4.8,  and  6.4-10'16,  and  at  x 
=  32  d,  TheoBR  yields  2.6,  4.3,  and  4.4-10  16,  respectively.  The  METAS-NIST  plot  has  a  slope  near  -1, 
which  implies  combined  measurement  noise  of  either  white  or  flicker  PM  (WHPM;  FLPM).  NPL-NIST  and 
PTB-NIST  have  shallower  slopes,  but  are  closer  to  FLPM  than  random-walk  PM/white  FM  (RWPM; 
WHFM). 

The  frequency-stability  values  shown  in  Figure  3a  are  similar  to  those  shown  for  the  PTB-NIST  link  in  [3] 
and  slightly  better  than  those  shown  for  the  OPMT-NISU  link  (2  li  <  x  £  32  h)  in  [4].  When  we  calculate  the 
modified  Allan  deviation  mod  oy(x)  [14],  the  stability  values  we  obtain  are  slightly  better  than  those  obtained 
by  [5]  along  the  OPMT-NISU  link  (MJDs  53304-53329  (October/November  2004))  for  x  <  16  h.  Our  mod 
oy(x)  values  are  worse  than  (or  sometimes  equal  to)  those  obtained  by  [5]  for  x  =  32-128  h;  this  makes  sense, 
because  their  processing  method  alleviates  day-boundary  discontinuities,  whereas  ours  does  not. 

ox(x)  remains  below  200  ps  for  the  METAS-NIST  link  out  to  21  d  8  h  (Figure  3b).  The  near- zero  slope  of 
the  plot  implies  that  the  noise  type  is  closer  to  FLPM  than  WHPM.  The  cx(x)  values  for  NPL-NIST  and 
PTB-NIST  tend  to  increase  with  averaging  time,  but  (again)  more  slowly  than  a  RWPM/WHFM  process 
would  imply.  Long-term  trends  are  visible  in  Figure  2  that  would  cause  ox(x)  to  increase  with  time.  It  is 
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FREQUENCY  STABILITY,  yGPScPFT  -  Ytwstft 


-♦-METAS-NIST 

NPL-NIST 

PTB-NIST 


AVERAGING  TIME  x(s) 


TIME  STABILITY,  xGpSCpFT-  xTWSTFT 


-♦-METAS-NIST 
-■-NPL-NIST 
-A-  PTB-NIST 


AVERAGING  TIME  x  (s) 


Figure  3.  Allan  and  time  deviations  of  GPSCPFT-TWSTFT  values  shown  in  Figure  2. 
Hollow  symbols  in  (a)  indicate  values  computed  using  TheoBR  [15]  rather  than  the 
overlapping  Allan  deviation  [14]. 
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also  possible  that  the  upward  trend  in  the  PTB-NIST  ax(x)  reflects  imperfect  removal  of  the  jumps  at  MJDs 
53888,  53926,  and  53936.  Regardless,  for  the  most  part,  the  time  stability  remains  less  than  or  equal  to  300 
ps  out  to  21  d  8  h.  These  values  of  cx(x)  are  slightly  better  than  those  (~  300-500  ps  for  2.3  <x<  74.7  d) 
shown  in  [3];  however,  the  interpolation  used  in  computing  cx(x)  may  have  biased  our  values  low.  No  time- 
stability  plots  were  published  for  the  OPMT-NISU  link  in  [4]  or  [5]. 

Figures  4a-c  show  the  difference  between  the  frequencies  measured  using  GPSCPFT  and  those  measured 
using  TWSTFT  for  the  epochs  shown  in  Table  3.  The  agreement  of  the  GPSCPFT-  and  TWSTFT-derived 
frequencies  obtained  for  METAS-NIST  changes  markedly  for  the  better  around  MJD  53840  (15  April  2006). 
While  yGPscPFr  -  y twstft  (10  d)  was  sometimes  as  large  as  1-2-10  15  before  this  date,  after  this  it  was  nearly 
always  less  than  5T0'16.  The  noise  level  and  structure  of  the  subtracted  time-transfer  values  shown  in  Figure 
2a  are  consistent  with  this,  although  in  Figure  2a,  there  appear  to  be  two  transitions:  one  to  smaller  large- 
scale  structure  around  MJD  53830,  and  another  to  a  distinctly  lower  noise  level  around  MJD  53875  (20  May 
2006). 

It  is  not  clear  what  caused  these  improvements.  Neither  the  GPSCPFT  nor  the  TWSTFT  hardware  had  been 
changed.  However,  there  are  events  that  correspond  to  the  dates  of  the  structure  changes  in  Figure  3a.  On  20 
April  (MJD  53845),  control  of  the  MET  AS  GPS  receiver  was  migrated  from  a  Windows  NT  to  a  Windows 
XP  computer.  Simultaneously,  the  software  generating  the  RINEX  files  was  changed  from  an  in-house  DOS 
program  to  Ashtech’s  Geodetic  Base  Station  Software.  It  is  not  known  how  (or  even  why)  such  changes  [17] 
would  affect  the  quality  of  data.  However,  the  dates  of  the  software  change  and  the  transition  to  better 
frequency  agreement  do  correspond.  It  is  also  possible  that  the  transition  to  better  results  was  aided  by  the 
cessation  of  a  freeze-thaw  cycle  somewhere  in  one  of  the  four  equipment  systems.  Figure  5  shows  that  the 
diurnals  in  the  METAS-NIST  TWSTFT  results  become  smaller  as  the  seasons  change  from  winter  to  spring, 
with  a  visible  transition  occurring  near  MJD  53875. 

As  Figure  4a  shows,  the  value  of  yGPscPFr  -  y twstft  of  METAS-NIST  decreases  as  the  averaging  time 
increases.  Therefore,  both  the  frequency  stability  (Figure  3a)  and  the  frequency  accuracy  (Figure  4a)  improve 
with  increased  averaging  time.  This  is  true  for  all  three  links.  The  METAS-NIST  frequency  agreement  over 
periods  of  30  d  is  remarkably  good:  1-3-10  16  in  the  earlier,  noisier  part  of  the  experiment,  and  from  3-10  17  to 
2- 10  16  in  the  latter,  quieter  part  of  the  experiment. 

oy(x)  is  defined  as  ( I  Nl)  times  the  RMS  value  of  the  difference  between  subsequently  measured  frequencies. 
It  measures  RMS  frequency  stability.  We  can  compute  the  RMS  of  the  frequency-accuracy  values  shown  in 
Figure  4  and  then  compare  accuracy  (RMS(ycpscPFT  -  y twstft))  and  stability  (ay(GPscpFT)  -  yn  wstft/X)).  We 
do  not  divide  RMS(ycpscPFT  -  y twstft)  by  V 2  because,  for  noise  processes  with  correlation  times  shorter  than 
or  equal  to  that  of  WHFM,  the  1  /N2  in  the  definition  of  ay(x)  compensates  for  the  fact  that  the  RMS  of  the 
subtraction  of  two  (noisy)  quantities  is  computed. 


RMS (y gpscpft  —  y twstft,  METAS-NIST,  10  d)  =  7.0-10  16 ,  exactly  the  same  as  ct^gpscpft)  - y(TwsTFT)  (X  =  10  d 
16  h).  RMS(yGpscPFT  -  yrwsTFT,  METAS-NIST,  30  d)  =  1.8-10  less  than  both  the  (Jy(GPScPFT)-y(TwsTFT)(x  = 
21  d  8  h)  and  TheoBKi x  =  32  d)  values  of  3.5  and  2.6-10  16,  respectively.  The  RMS  frequency  accuracy 
appears  to  be  less  than  or  equal  to  the  frequency  stability,  and  hence  there  appeal's  to  be  no  frequency  bias 
between  GPSCPFT  and  TWSTFT. 

The  NPL-NIST  frequency  values  produced  by  GPSCPFT  and  TWSTFT  typically  agreed  at  0.5-1.5-10  15 
when  computed  over  10  d  intervals  (Figure  4b).  Again,  the  agreement  is  significantly  better  over  30  d 
periods,  with  all  lyGPscPFT  -  yrwsTFTl  values  —  5.5-10  .  RMS  (yGPsePFT  —  yrwsTFT,  NPL-NIST,  10  d)  =  9.6- 
10  16 ,  similar  to  cty( gpscpft)  -  y(TwsTFT)  (x  =  10  d  16  h)  of  1.1-10  15.  RMS  (yGpscPFT  -  y twstft?  NPL-NIST,  30 
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d)  =  3.8-10'16,  smaller  than  cTvigpscpfi  )  -  y(TwsTFT)  (X  =  21  d  8  h)  and  IheoBRi x  =  32  d)  of  4.8  and  4.3-10  16, 
respectively.  The  curvature  of  the  plot  of  the  30  d  values  suggests  that  a  twice  per  year  periodic  effect  is  at 
work  here.  A  longer  data  set  is  needed  to  observe  whether  this  trend  continues. 

The  quantity  yGPscPFr  -  yxwsTPT-  PTB-NIST,  10  d  often  reached  1.5-2-10  15  in  the  early  months  of  the 
experiment.  However,  it  became  smaller  as  the  experiment  progressed,  with  a  resulting  RMS  value  of  1.1-10 
15.  Oy(GPscpFT)  -  y(TwsTFT)  (x  =  10  d  16  h)  was  nearly  the  same:  1.2-10  l5.  The  agreement  between  yGPscPFr  and 
yrwsTFT  improves  with  increased  averaging  time,  and  for  averaging  times  of  30  d,  except  for  the  first  value  at 
MJD  53780,  lyGPScPFr  —  yTwsTFrl  <  2-10  .  RMSlycpscpm  —  yrw  s  i  it-  PTB-NIST,  30  d)  =  2.5-10  .  Although 
this  value  is  skewed  by  the  point  at  MJD  53780,  it  is  smaller  than  the  values  of  ct^gpscpft)  - ycrwsTFT)  (X  =  21  d 
8  h)  and  TheoBR(x  =  32  d),  respectively  6.4  and  4.4-10  16,  which  also  would  have  been  biased  high  by  the 
earlier,  noisier  values. 

As  a  final  test  for  small  frequency  biases  between  GPSCPFT  and  TWSTFT,  we  computed  the  mean,  p,  and 
the  standard  deviation  of  the  mean,  oM,  for  the  nine  time  series  shown  in  Figures  4a-c.  oM  was  computed  by 
dividing  the  standard  deviation  of  the  time  series  by  V N,  where  N  is  the  number  of  points  in  each  time  series. 
The  results  are  shown  on  each  plot.  The  mean  values  of  yGPscPFr  -  y twstft  range  from  1.4-10  17  to  1.9-10  16, 
with  the  uncertainties  of  the  means  always  larger  than  the  means  themselves.  The  largest  sum  of  p  +  oM 
observed  was  (1.9  +  2.7)-10  16  =  4.6-10  16  (yGPscPFr  -  y twstft?  PTB-NIST,  10  d).  Thus,  over  the  6-month 
period  of  this  study  and  within  this  limit,  there  appeared  to  be  no  long-term  frequency  bias  between 
GPSCPFT  and  TWSTFT. 


DISCUSSION 

It  is  encouraging  that  the  RMS  values  of  yGPscPFT  -  y twstft  are  small  (1.8  to  3.8-10  16)  at  the  30  d  averaging 
time,  and  that  yGPscPFT  -  y twstft  (30  d)  never  exceeds  5.5-10  16.  If  we  assign  the  noise  equally  to  GPSCPFT 
and  TWSTFT,  our  worst-case-scenario  5.5-10  16  agreement  implies  that  either  technique  has  a  frequency- 
measurement  uncertainty  of  ~  3.9-10'16.  This  level  of  uncertainty  is  useful  in  comparing  many  PFSs. 

It  is  also  encouraging  that  we  are  unable  to  detect  any  long-term  GPSCPFT-TWSTFT  frequency  bias  over 
the  6  months  of  this  experiment.  It  would  be  nice,  however,  if  the  values  of  yGPscPFT  -  y twstft  could  be  made 
considerably  and  consistently  smaller  at  the  10  d  averaging  time. 

Hackman  et  al.  [2]  demonstrated  yGPscPFT  -  y twstft  RMS  values  of  a  few  to  several  parts  in  1016  for  6  to  17  d 
averaging  times  for  two  short-term  experiments  (13  to  17  d  apiece)  along  the  PTB-NIST  link.  In  those 
experiments,  the  maximum  (worst)  value  of  yGPscPFT  -  y twstft  never  exceeded  1-10  15  for  x  >  9  d.  That  is 
better  agreement  at  short  timescales  than  was  achieved  in  the  present  experiment  for  PTB-NIST  (or  any  other 
link).  The  same  GPS  receivers  and  TWSTFT  antennae/modems  were  used  at  NIST  and  PTB  in  both  [2]  and 
the  present  experiment,  although  the  AOA  SNR-8000  receiver  at  NIST  received  an  ACT  upgrade  in  the 
interim.  We  hypothesize  that  superior  results  were  obtained  in  [2]  because  the  effects  of  the  day-boundary 
discontinuities  were  mitigated  more  effectively.  As  mentioned  previously,  the  day-boundary  discontinuities 
for  PTB-NIST  are  particularly  large,  and  we  have  not  yet  been  able  to  remove  or  otherwise  circumvent  them 
effectively  in  this  experiment,  i.e.,  in  a  way  that  yields  better  results  than  those  shown  in  Figure  4.  This  is 
true  for  all  three  links. 
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Figure  4.  Difference  between  frequency  values  obtained  from  GPSCPFT  and  TWSTFT. 
The  RMS,  mean  (|i)  and  the  uncertainty  of  the  mean  (cLI)  are  labeled  on  each  plot  for 
each  time  series. 
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Figure  5.  METAS-NIST  time-transfer  values  obtained  from  TWSTFT  29  Jan  -  31  Jul  2006 
(drift  and  frequency  offset  removed).  The  diurnals  in  the  TWSTFT  values  grow  smaller  as 
winter  becomes  spring,  with  a  noticeable  transition  around  MJD  53875. 


Work  is  underway  to  mitigate  the  effects  of  the  day-boundary  discontinuities  in  the  present  experiment.  We 
hope  that  by  doing  so,  we  can  reduce  the  combined  uncertainties  of  GPSCPFT  and  TWSTFT  at  shorter  (e.g., 
10  d)  averaging  times. 


CONCLUSIONS 

The  frequency  values  obtained  from  GPSCPFT  and  TWSTFT  agreed  at  1.8  to  3.8T0  16  RMS  for  30  d 
averaging  times.  No  single  value  of  yGPsePFT  -  y twstft  (30  d)  exceeded  5.5-10  l6,  which  would  yield  3.9-10  16 
frequency  accuracy  for  either  GPSCPFT  or  TWSTFT  if  the  uncertainty  were  divided  equally  between  the  two 
techniques.  RMS  frequency-accuracy  values  were  equal  to  or  less  than  the  frequency-stability  measure  Gy(x), 
and  in  general,  no  frequency  bias  between  GPSCPFT  and  TWSTFT  was  observed. 

The  values  of  yGPsePFT  -  y twstft  obtained  for  a  given  link  often  varied  with  time.  This  was  especially 
noticeable  in  the  yGPsePFT  -  y twstft  values  obtained  for  averaging  times  of  10-15  d,  with  yGPsePFT  -  y twstft 
sometimes  becoming  as  large  as  2-10  l5.  It  is  not  yet  clear  what  caused  these  variations.  The  RMS  values  of 
y gpscpft  -  y twstft  (10  d)  ranged  from  0.7  to  1.1-10  15,  with  RMS  (yGPsePFT  -  y twstft  (10  d))  generally  equal 
to  (Ty(GPSCPFT)  -  y(TWSTFT)  (X  =  10  d  8  ll). 
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Some  of  the  noise  in  yGPscPFr  -  yrwsTFT  may  be  due  to  environmental  factors  presently  beyond  our  control. 
Analysis  of  a  longer  data  set  would  allow  us  to  investigate  how  the  time-dependent  aspects  of  TWSTFT - 
GPSCPFT  performance  evolve.  However,  we  believe  that  some  of  the  short-term  noise  is  also  due  to  our 
inability  (in  the  present  experiment)  to  mitigate  the  effects  of  day-boundary  discontinuities.  Better  RMS 
values  of  yGPscPFr  -  yrwsTFT  for  averaging  times  of  6  -  17  d  were  demonstrated  in  [2],  an  experiment  in  which 
day-boundary  discontinuities  were  effectively  managed.  We  hope  to  achieve  similar  (or  at  least  improved) 
short-term  performance  once  this  problem  has  been  resolved. 
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